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Abstract 

This study investigates the problem of communication for a network composed of two half-duplex parallel relays 
with additive white Gaussian noise. Two protocols, i.e., Simultaneous and Successive relaying, associated with two 
possible relay orderings are proposed. The simultaneous relaying protocol is based on Dynamic Decode and Forward 
(DDF) scheme. For the successive relaying protocol: (i) a Non-Cooperative scheme based on the Dirty Paper Coding 
(DPC), and (ii) a Cooperative scheme based on the Block Markov Encoding (BME) are considered. Furthermore, the 
composite scheme of employing BME at one relay and DPC at another always achieves a better rate when compared 
to the Cooperative scheme. A "Simultaneous-Successive Relaying based on Dirty paper coding scheme" (SSRD) is 
also proposed. The optimum ordering of the relays and hence the capacity of the half-duplex Gaussian parallel relay 
channel in the low and high signal-to-noise ratio (SNR) scenarios is derived. In the low SNR scenario, it is revealed 
that under certain conditions for the channel coefficients, the ratio of the achievable rate of the simultaneous relaying 
based on DDF to the cut-set bound tends to be 1. On the other hand, as SNR goes to infinity, it is proved that 
successive relaying, based on the DPC, asymptotically achieves the capacity of the network. 



I. Introduction 

A. Motivation 

The continuous growth in wireless communication has motivated information theoretists to extend shannon's 
information theoretic arguments for a single user channel to the scenarios that involve communication among 
multiple users. 

Financial supports provided by Nortel, and the corresponding matching funds by the Federal government: Natural Sciences and Engineering 
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In this regard, cooperative wireless communication has been the focus of attention during recent years. Due 
to rapid decrease of the transmitted signal power with distance, the idea of multi-hopped communication has 
been proposed. In multi-hopped communication, some intermediate nodes as relays are exploited to facilitate data 
transmission from the source to the destination. Using this technique leads to saving battery power as well as 
increasing the physical coverage area. Moreover, relays by emulating distributed transmit antenna, can form spatial 
diversity and combat the multi-path fading effect of the wireless media. 

Motivated by practical constraints, half-duplex relays which cannot transmit and receive at the same time and in 
the same frequency band are of great importance. Here, our goal is to study and analyze the performance limits of 
a half-duplex parallel relay channel. 

B. History 

Relay channel is a three terminal network which was introduced for the first time by Van der Meulen in 1971 
[1]. The most important capacity results of the relay channel were reported by Cover and El Gamal [2]. Two 
relaying strategies are proposed in [2]. In one strategy, the relay decodes the transmitted message and forwards the 
re-encoded version to the destination, while in another one the relay does not decode the message, but sends the 
quantized received values to the destination. 

Moreover, several works on multi-relay channels exist in the literature (See [3] — [ 11], [23], [29]-[36]). Schein 
in [3], [4] establishes upper and lower bounds on the capacity of a full-duplex parallel relay channel in which the 
channel consists of a source, two relays and a destination, where there is no direct link between the source and the 
destination, and also between the two relays. Generally, the best rate reported for the full-duplex Gaussian parallel 
relay channel is based on the Decode-Forward (DF) or Amplify-Forward (AF) schemes, with time sharing [3], [4]. 
Xie and Kumar generalize the block Markov encoding scheme in [2] for a network of multiple relays [5]. Gastpar, 
Kramer, and Gupta extend compress and forward scheme to a multiple relay channel by introducing the concept 
of antenna polling in [6]-[8]. In [9], Amichai, Shamai, Steinberg and Kramer consider a parallel relay setup, in 
which a nomadic source sends its information to a remote destination via some relays with lossless links to the 
destination. They investigate the case that these relays do not have any decoding capability, so signals received at the 
relays must be compressed. The authors also fully characterize the capacity of this case for the Gaussian channel. 
In [10], Marie and Yates investigate DF and AF schemes in a parallel-relay network. Motivated by applications in 
sensor networks, they assume large bandwidth resources allowing orthogonal transmissions at different nodes. They 
characterize optimum resource allocation for AF and DF and show that the wide-band regime minimizes the energy 
cost per information bit in DF, while AF should work in the band-limited regime to achieve the best rate. Razaghi 
and Yu in [11] propose a parity-forwarding scheme for full-duplex multiple relay. They show that parity-forwarding 
can achieve the capacity in a new form of degraded relay networks. 

Radios that can receive and transmit simultaneously in the same frequency band require complex and expensive 
components [18]. Hence, Khojastepour and Aazhang in [13], [14] call the half-duplex relay as "Cheap Relay'". 

Recently, half-duplex relaying has drawn a great deal of attention (See [13]— [19], [23], [29]-[36]). Zahedi and 
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El Gamal consider two different cases of frequency division Gaussian relay channel, deriving lower and upper 
bounds on the capacity [15]. They also derive single letter characterization of the capacity of frequency division 
additive white Gaussian noise (AWGN) relay channel with simple linear relaying scheme [16], [17]. The problem 
of time division relaying is also considered by Host-Madsen and Zhang [18]. By considering fading scenarios, 
and assuming channel state information (CSI), they study upper and lower bounds on the outage capacity and the 
Ergodic capacity. In [19], Liang and Veeralli present a Gaussian orthogonal relay model, in which the relay-to- 
destination channel is orthogonal to the source-to-relay and source-to-destination channel. They show that when the 
source-to-relay channel is better than the source-to-destination channel and the signal-to-noise ratio (SNR) of the 
relay-to-destination is less than a given threshold, optimizing resource allocation causes the lower and the upper 
bounds to coincide with each other. 

C. Contributions and Relation to Previous Works 

In this paper, we study transmission strategies for a network with a source, a destination, and two half-duplex 
relays with additive white Gaussian noise which cooperate with each other to facilitate data transmission from the 
source to the destination. Furthermore, it is assumed that no direct link exists between the source and the destination. 

Half-duplex relaying, in multiple relay networks, is studied in [23], [29]-[36]. Gastpar in [23] shows that in a 
Gaussian parallel relay channel with infinite number of relays, the optimum coding scheme is AF. Rankov and 
Wittneben in [29], [30] further study the problem of half-duplex relaying in a two-hop communication scenario. 
In their study, they also consider a parallel relay setup with two relays where there is no direct link between the 
source and the destination, while there exists a link between the relays. Their relaying protocols are based on either 
AF or DF, in which the relays successively forward their messages from the source to the destination. We call this 
protocol "Successive Relaying" in the sequel. Xue and Sandhu in [31] further study different half-duplex relaying 
protocols for the Gaussian parallel relay channel. Since they assume that there is no link between the relays, they 
refer to their parallel channel as a Diamond Relay Channel. 

In this work, our primary objective is to find the best ordering of the relays in the intended set-up. We consider 
two relaying protocols, i.e., simultaneous relaying versus successive relaying, associated with two possible relay 
orderings. For simultaneous relaying, each relay exploits "Dynamic DF (DDF)". It should be noted that the DDF 
scheme considered here is slightly different from the DDF introduced in [34] and [35]. In those works, the DDF 
scheme is applied to the set-up of the multiple relay network in which the nodes only have the CSI of their receiving 
channel. In the DDF scheme described in [34], the source is broadcasting the message to all the network nodes 
during whole period of transmission and each relay, listens to the transmitted signal of the source and other relays 
until it can decode the transmitted message. Consequently, it transmits its signal coherently with the source and 
other active relays in the remaining time. However, in our set-up, all the nodes are assumed to have all the channel 
coefficients. Therefore, in a fixed pre-assigned portion of the time, the relays receive the signal transmitted from 
the source, and in the remaining time slot they transmit the re-encoded version of the decoded message together. 
In other words, the relays operate in a synchronous manner. 
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For successive relaying, we study a Non-Cooperative scheme based on "Dirty Paper Coding (DPC)" and also a 
Cooperative scheme based on "Block Markov Encoding (BME)". It is worth noting that the authors in [36] also 
propose successive relaying protocol for the set up with two parallel relays and direct links between the relays and 
between the source and the destination. They propose a simple repetition coding at the relays, and show that their 
scheme can recover the loss in the multiplexing gain, while achieving diversity gain of 2. 

We derive the optimum relay ordering in low and high SNR scenarios. In low SNR scenarios and under certain 
channel conditions, we show that the ratio of the achievable rate of DDF for simultaneous relaying to the cut-set 
bound tends to one. On the other hand, in high SNR scenarios, we prove that the proposed DPC for successive 
relaying asymptotically achieves the capacity. 

After this work was completed, we became aware of [32] which has independently proposed an achievable rate 
based on the combination of superposition coding, BME and DPC. In their scheme, the intended message "io" is 
split into a message which is transmitted to the destination by exploiting cooperation between the relays "u> r " and 
a message which is transmitted to the destination without using any cooperation between the relays "u>d" . Hence, 
the signal associated with u Wd', transmitted by one relay, can be considered as interference on the other relay, 
"uv" is transmitted by using BME and u Wd" is transmitted by employing DPC. Therefore, in their general scheme, 
the associated signals with these two messages are superimposed and transmitted. As the channel between the two 
relays become strong, their proposed scheme is converted to BME. On the other hand, as the channel becomes 
weak, their proposed scheme becomes DPC. 

Unlike [32], in which the authors only consider successive relaying and propose a combined BME and DPC, as 
the main result of this paper, simultaneous and successive relaying protocols are combined and a "Simultaneous- 
Successive Relaying based on Dirty paper coding" (SSRD) scheme with a new achievable rate is proposed. It is 
shown that in the low SNR scenario and under certain channel conditions, SSRD scheme is converted to simultaneous 
relaying based on DDF, while in the high SNR scenarios, when the ratio of the relay powers to the source power 
remain constant, it becomes successive relaying based on DPC (to achieve the capacity). 

Besides this main result, some other results obtained in this paper are as follows: 

• Two different types of decoding, i.e., successive and backward decoding, at the destination for the BME scheme 
are proposed. We prove that the achievable rate of BME with backward decoding is greater than that of BME 
with successive decoding, i.e., C l £f /[Eh k > C l £'^ IEs . 

• It is proved that BME with backward decoding leads to a simple strategy in which at most, one of the relays is 
required to cooperate with the other relay in sending the bin index of the other relay's message. Accordingly, 
in the Gaussian case, the combination of BME at one relay and DPC at the other relay always achieves a 
better rate than the simple BME. 

• In the degraded case, where the destination receives a degraded version of the received signals at the relays, 
BME with backward decoding achieves the successive cut-set bound. 

The rest of the paper is organized as follows: In section II, the system model is introduced. In section III, the 
achievable rates and coding schemes for a half-duplex relay network are derived. Optimality results are discussed 
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in section IV. Simulation results are presented in section V. Finally, section VI concludes the paper. 



D. Notation 

Throughout the paper, the superscript H stands for matrix operation of conjugate transposition. Lowercase bold 
letters and regular letters represent vectors and scalars, respectively. For any two functions f(n) and g(ri), f(n) = 



0(g(n)) is equivalent to lim„ 



/(«) 



g( n ) 



< oo, and f(n) = <d(g(n)) is equivalent to lim n _ 



/(«) 
+ °° g(n) 



c, where 



< c < oo. And C{x) = | log 2 (l + x). Furthermore, for the sake of brevity, Ac denotes the set of weakly jointly 
typical sequences for any intended set of random variables. 

II. System Model 

We consider a Gaussian network which consists of a source, two half-duplex relays, and a destination, and there 
is no direct link between the source and the destination. Here we define four time slots according to the transmitting 
and receiving mode of each relay (See Fig. ??), where t& denotes the duration of time slot b (J2b=i ^ = Nodes 
0, 1, 2, and 3 represent the source, relay 1, relay 2, and the destination, respectively. Moreover, the transmitting 
and receiving signals at node a during time slot b are represented by Xa and yi b , respectively. Hence, at each 
node c G {1, 2, 3}, we have 



E 

ae{0,l,2} 



h 



,i b ) 



(1) 



where h ac 'S denote channel coefficients from node a to node c, and is the AWGN term with zero mean and 
variance of "1" per dimension. 

Noting the transmission strategies in Fig. ??, we have 

(2) 
(3) 
(4) 
(5) 
(6) 

(7) 

fe=l 

Throughout the paper, we assume that hoi > h,Q2 unless specified otherwise, and from reciprocity assumption, 
we have h±2 = h>2i. Furthermore, the power constraints Pq, P±, and P2 should be satisfied for the source, the 
first relay, and the second relay, respectively. Hence, denoting the power consumption of node a at time slot b by 
we have 
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Source 



Source 



Relay 1 




Destination 



Relay 2 

a) Time slot 1 with duration tj: 

The source and the second relay transmit 
the vectors Xg and x^ 1 '. 
The first relay and the destination receive 
yi and yfj 1 ', respectively. 



Relay 1 




Destination 



Relay 2 
Time slot 3 with duration t%: 
The source transmits the vector x| 



(3) 



The first and the second relay receive yi' 



(3) 



and y 2 3 ' , respectively. 



Relay 1 



Source 




Destination 



Relay 2 

b) Time slot 2 with duration tg: 

The source and the first relay transmit 



the vectors x 2 ' and x\' 
The second relay and the destination receive 
Y2 and y^ 2 ' , respectively. 



(2i 



Relay 1 



Source # 




Destination 



Relay 2 

d) Time slot 4 with duration tj: 

The relays transmit the vectors x' 4 ' and x^ 4 ' . 



The destination receives y^ 



(4) 



Fig. 1. System Model. 



III. Achievable Rates and Coding Schemes 

In this section, we propose two cooperative protocols, i.e. Successive and Simultaneous relaying protocols, for a 
half-duplex Gaussian parallel relay channel. 

A. Successive Relaying Protocol 

In Successive relaying protocol, the relays are not allowed to receive and transmit simultaneously, i.e. t$ = <4 = 0, 
and the relations between the transmitted and the received signals at the relays and at the destination follow from 
©-(O. For the successive relaying protocol, we propose a Non-Cooperative and a Cooperative Coding scheme in 
the sequel. In the proposed schemes, the time is divided into odd and even time slots with the duration t\ and t<i, 
respectively. Accordingly, at each odd and even time slots, the source transmits a new message to one of the relays, 
and the destination receives a new message from the other relay, successively (See Fig. 0. 
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Fig. 2. Information flow transfer for successive relaying protocol for two relays. 



1) Non-Cooperative Coding: In the Non-Cooperative Coding scheme, each relay considers the other's signal as 
interference. Since the source knows each relay's message, it can apply the Gelfand-Pinsker's coding scheme to 
transmit its message to the other relay. The following Theorem gives the achievable rate of this scheme. 



Source 




Destination 



Time Slot 1 with duration ti 




Source 



Destination 



Time Slot 2 with duration ts 



Fig. 3. Successive relaying protocol based on Non-Cooperative Coding. 



Theorem 1 For the 

achievable: 



half-duplex parallel relay channel, assuming successive relaying, the following rate Cffp C 



is 



CjSp C = max rW+bP\ 

0<tl,t 2 ,tl+*2 = l 

subject to: 

i^min^I^V^ 



with probabilities: 



— - LAJaAA l r. v V i'l ; J V^0 i yl 2 Ni^V-l ^3 

?( 2 ) < min (t 2 (I(uW ;Y^)-I(U^;X[ 2 %t 1 I(X^;Yj 



P(4 



P (4 2) , 4 2) , 4 2) ) = p(4 2) M4 2) i 4 2) m4 2) i4 2) , 4 2) ) • 



(9) 

(10) 
(11) 
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Proof: See Appendix A. ■ 
From Theorem Q] the achievable rate of the proposed scheme for the Gaussian case can be obtained as follows. 

corollary 1 For the half-duplex Gaussian parallel relay channel, assuming successive relaying protocol with power 
constraint at the source and at each relay, DPC achieves the following rate: 

C l £% c = max + i?< 2 >) , (12) 

subject to: 



2 p(l) 

o 



i?« < min Uc 

< min UC t^MSL 



P 



(i) 



pr = p , 



hj 3 Pi 

tl 



h+t 2 = l, 

0<ti,t 2 ,P (1) ^o 2) - 
Proof: From Costa's Dirty Paper Coding [28], by having 



rr(l) _ 



(1) 



>(2) 



-X 



(1) 



r .(2) _ „(2) h 02 h 12 P (2) 

^° + ^FT^ 1 • 



(13) 



(14) 



where X (1) - Af(0, P (1) ), X^ 2) ~ A/"(0, P (2) ), X 2 (1) ~ JV(0,P 2 ), and x[ 2) ~ JV(0,Pi), and applying them to 
Theorem Q] we obtain corollary Q] ■ 



(&< b 1 »;fi;< b )) 



X^VV* ^ 2) ) 




,.(b 2) _(b 2)\ (2)/ (b)| (b 1) (b 2) 



2) ) 



(2), ( b l)i (b 2)% (2)/ (b 2K 
Xj («f° '|s 2 )/"Ui (S 2 ) 




(4 b 2) ;i/ b 2 ') 



(fi/ b 1 » ; ™< b ») 



Fig. 4. Successive relaying protocol based on Cooperative Coding. 



2) Cooperative Coding: In this type of coding scheme, we assume that, at each time slot, the receiving relay 
decodes not only the new transmitted message from the source, but also the previous message transmitted from the 
transmitting relay (See Figs. [2] and |4). Our proposed coding scheme is based on binning, superposition coding, and 
Block Markov Encoding. The source sends B messages w^ 2 \ ■ ■ ■ , if/ 5 - 1 in B + 2 time slots. 

Generally, this scheme can be described as follows (See Figs. |4] and |5}. In time slot 6, the relay (b+ 1) mod 2+1 
decodes the transmitted messages and w^^ 1 ^ from the source and the other relay, respectively. In time slot 
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Block 1 



Block 2 



Block 3 



Block 4 



Source 



Relay 1 



Relay 2 



4V 1} |i;i) 



x«(l[l);uHl) 



4 2) (w (2) |w (1) ;i) 



cf(wW|l);u< 2 »(l) 



x^^w^lw' 2 ';.?' 1 )) 



x< 2) (w< 4 )|w( 3 >;4 2) ) 



Fig. 5. Decode-and-forward for successive relaying protocol. 



6 + 1, it broadcasts and the bin index of w^ h l \ mod 2+r t0 ^ e destination using the binning function 

defined next. 

Definition (The Binning Function): The binning function f { £+ 1] mod 2+1) (w^ ) : W = {1, 2, • ■ ■ , 2"« (<i,+1) ^ 2+1) 



((ij + l) mod 2+1) 
{1, 2, . . . , 2" r Bin 



}is defined byf^ mod2+1 \ 



it' 1 



,(6-2) 



where f ((b+1) mod 2+1) C ^ 

S (b+1) mod 2+1' Wllere J Bin V) 



((b+1) mod 2+1) 



independently to each member of 



assigns a randomly uniform distributed integer between 1 and 2™^™ 
W. 

As indicated in Fig. [5] in the first time slot, the source transmits the codeword Xq (w^ 1 ^ |1, 1) to the first relay, 
while the second relay transmits a doubly indexed codeword X2 (1|1) and the codeword u^fl) to the first relay 
and to the destination. In the second time slot, the source transmits the codeword (u/ 2 ' \w W , 1) to the second 
relay, and having decoded the message the first relay broadcasts the codewords x^\w^\l) and Uj 2 (1) to 

the second relay and to the destination. It should be noted that the destination cannot decode the message uiW at 
the end of this time slot; however, the second relay decodes 10 W and tt/ 2 ) messages. Using the binning function, it 
finds the bin index of according to = fBi n ( w ^)- ^ n tne third time slot, the source transmits the codeword 



s\ ly ) to the first relay, and the second relay broadcasts the codewords x 2 (tt/ 2 ) \s^') and u^^sj 1 ) 



to the first relay and to the destination. 

Two types of decoding can be used at the destination: successive decoding and backward decoding. Successive 
decoding at the destination can be described as follows. At the end of the 6th time slot, the destination cannot decode 
the message if however, having decoded the bin index s [b + ij mod 2 +i fr° m the received vector of the &th time 
slot, it can decode the message tt/ b ~ 2 ) from s [t + ij mot i 2 +i ar, d the received vector of the (6 — l)th time slot. On 
the other hand, backward decoding can be explained as follows. Having received the sequence of the B + 2'th time 
slot, the final destination starts decoding the intended messages. In the time slot B + 2, one of the relays transmits 
the dummy message "1" along with the bin index of the message tt/ s ) to the destination. Having received this bin 
index, the destination decodes it, and then backwardly decodes messages w^ b \ b = B, B — 1, • ■ ■ ,1 and their bin 
indices. The following Theorem gives the achievable rate of the proposed scheme. 



} 



Theorem 2 For the half-duplex parallel relay channel, assuming successive relaying, the BME scheme achieves 
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the rates C%$ Eb 



and C 



low 
BAIE b 



using successive and backward decoding, respectively: 



C 



low 
BME. 



< max min ( 

0<*l,*2,tl+t2 = l 



■(i).v(i) 



min (hi (X^ J ;Y 



•W.vW 



X 



(1) 



Y, 



(i) 



(i) 



t 2 I(U {2) ^ 2) 



Ul X^'-Y 



(2). v (2) 



i J 2 



(1) 



+ T I v( 2 ). V< 2 ) 



(2) 



w;f/i probabilities 



C 



low 
BAIE b 



m4^4^4 1) ) = p(4 1) m4 1) i4 1) m4 1) i4 1) ,4 1) ), 

p (4^4^4 2) )=p(4 2) m4 2) i4 2) m4 2) i4 2) ,4 2) ), 
p(4 1) ,4 1) )=k4 1) m4 1) i4 1) ), 

p(4 2) ,4 2) )=p(4 2) m4 2 V1 2) ). 

i unn(tj(x£\x^;Y^) 1 t 2 l(xf\x?;Y 



max 

o<t 1 ,t 2 ,t 1 +t 2 



(2) 



* 1 /(x<V 1 (1) |* 2 (1) )+* 



ti/(x«;y 3 (1) 



t 2 I (x[ 2) ;Y 3 {2) 



with probabilities 



(15) 



(16) 



k4 1) .4 1) )=p(4 1) )p(4 1) i4 1) ). 
p^ 2) ,4 2 ))=k4 2) m4 2) i4 2) )- 

Proof: See Appendix B. ■ 
Now, the following set of propositions and corollaries investigate the Non-Cooperative and Cooperative schemes 
and compare them with each other. 



Proposition 1 The BME with backward decoding achieves a better rate than the one with successive decoding, 
i e (ji° w > ^jiow 

BME back — BME SUCC ' 

Proof: For the first term of minimization $15[ , we have 



min ( tl I ( X«; | X™ , t/« ) , t 2 I ( X? ; y 3 W I U™ 



hI(uP;YP 



min ( tl J (Af | ^W) + taJ (^). y(») ^ (jtf> ; yf | xf \ [/< 

min( W (x«;F« |X«,f/«) + fel (xf; if | x[ 2 \ u[ 



(2) 



tl I[xVu?>;YV> 



t 2 i(x[ 2 \u[ 2 ^ 



< 



(17) 
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Let us focus on tj (x^iY^ \ X^\u. 



(i) 



(2). v (2) I Y (2) T A2) 



tl l(x^;Y^\X?\uP 



t 2 I(X^;Y 2 {2) \x[ 2 \u^ { - ] 



tiH (Y'l 



(i) 



t 2 H(Y 



xp,ui x) 



X {2 \u {2) )-t 2 H[Y 2 



— t\H I Y{ 



A ) A 2 



(2) | x (2) x (2) 



hHlY^ \X^)-t l H[Yi 



(i) 



<2^( 



1" 



(2) 



A i A 2 



A i A l 



'(1) 



(6) 
< 



(18) 



(a) and (c) follow from the definition of mutual information, the fact that U 2 



(i) 



A ! A 2 



K (1) and 



^1 



(2) 



(x^ 2 \x[ 2 ^ — ► Y 2 2 ^ form Markov chain, and (6) follows from the fact that conditioning reduces 



entropy. Inequality (6) becomes equality if pix^, x£\ i4 ) = P(4 1 'M4 W ) and p(ccq 2 ' , a^ 2 \ it^) 

pCuf^P^i^X^ki^) ■ Usin g the similar argument for t t I (x£\ C/ 2 (1) ; Y^ + t 2 I (x[ 2) , u[ 2) ; F 3 (2) V 



,, and t 2 J(^ 2) ,x( 2) ;F 2 (2) 



J/f 5 ) in Q3) and ([T7J, and the fact E7, 



(i) 



(i) 



y 3 (1) , u[ 2) 



(2) 



(2) rr(l) 



A i A 2 



y(2) y (2) 
A i A l 



Y 



(2) 



chain, and Appendix B, along with comparing Cg^ and Cg'^ in Theorem|2] we have C 



form Markov 



From Theorem 12 we have the following corollary for the Gaussian case. 

corollary 2 For the half-duplex Gaussian parallel relay channel, assuming successive relaying protocol with power 
constraint at the source and each relay, BME achieves the following rates 



C l BME succ — max mm {pBME! + Cbme 2 



feoi-Po^ + ^12^2 + 2h ol h 12 yJa 1 2 P^ ) P 2 



t 2 C 



hl 2 P^ 2) + hl&P-L + 2ho 2 h 12 ^/a 2 e 1 P^ 2) P 1 



(19) 



^BME baok 



max min tiC 



^iPo 1] + ^12^2 + 2/ioifcia \/0iP^'P: 



t 2 C 



fe§ 2 P (2) + /i^Pl + 2h 02 h 1 2 



,(2) 



tiC< 



ti 



t 2 C 



(20) 
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subject to: 

— *°{iggk) + «'(^)) ■ < 21 > 

p(l) , p(2) _ p 
tl+«2 = 1, 

< ai, a 2 < 1, 

0</?l,/3 2 < 1, 

< 9 1: 9 2 < 1. 

where 9 i = 1 — a, = 1 — «£, one/ /3j = 1 — /?,; /or i = 1,2. 



Proo/: Let y (1) ~ Ar(0,oiP (1) ),^ (a) ~ AA(0, a 2 P (2) ), V 2 (1) ~ AT(0, 6 2 P 2 ), V± 2) ~ 7V(0,fliPi), C/ 2 (1) 
7V(0, # 2 P 2 ) and C/ 1 (2) ~ W(0, fliPi) , which are independent of each other. 

Letting X« = + J^vi 1 ^ = V$» + J^vfKx™ = + I$\ X?> = V™ + u[ 
and using the result in the expression for the achievable rate obtained in Theorem Q] we obtain C l £f IE for tl 
Gaussian case, as given in [32] and (fT~9T >, (1211 1. and ( f22b . respectively. 

For backward decoding, let F (1) - 7V(0, /?iP (1) ), y o (2) - A/"(0, /? 2 P (2) ), X y ~ A ^(0,P 2 ), and xf 5 
7V(0,Pi), which are independent of each other. By setting X^ = V (1) + J^^-X^\ x[ 2) = V (2) 



^p-X[ 2) and using the result in the expression for the achievable rate obtained in Theorem [U we obtain 
@bme k ^ or tne Gaussian case, as given in ( f20b . ■ 

Proposition 2 In symmetric scenarios, where hoi = ho2, his = h 2 3, and Pi = P 2 , Non- Cooperative DPC scheme 
outperforms Cooperative BME scheme, i.e. Cg]^ E < C l £p C . 



Proof: Due to the symmetric assumption, we have t\ = t 2 = |> Pq ^0 ^ anc l A = = |- Hence, 
from (1201) . we have 

C^ 6oofe < min (c , C (2^3^)) • (23) 

And also C l £p C in (fl2l becomes 

<7gjS c = min (c {h 2 01 P Q ) , ho (h 2 0l P ) + hj {2h\ z P x ) , C (2fc? 3 i\)) . (24) 

Comparing (El and (EH, we have C l £f IEbaak < C l g$ c . ■ 
According to the discussion in Appendix B, r^J = or rS = 0. In other words, in the Cooperative BME 
scheme based on backward decoding, at most one relay is necessary to use binning function for the message it 
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receives from another, and the other relay is not necessary to cooperate with this relay. Therefore, we propose a 
composite BME-DPC scheme. In this scheme, one of the relays decodes the other relay's message. Having decoded 
that, it then uses the binning function to cooperate with the other relay. On the other hand, using the Gelfand- 
Pinsker's result the source cancels the interference due to one relay on the other. Hence, we have the following 
Theorem. 

Theorem 3 The composite BME-DPC scheme, achieves the following rate: 

C%£ie-dpc = max ^ 1 min (tj (x^\x^-Y^) , t x I (x^;Y^ \ X^ 



0<tl,*2,tl+*2 = l 



h ( I (UP ; F 2 (2) ) I ( ; XP) ) + t 2 l(x™ ; Y 3 (2) ) ) . (25) 



Proof: Assuming r^l = 0, and using Theorem[T]and Theorem [2] along with a similar argument as in Appendix 
B, Theorem [3] is immediate. ■ 

corollary 3 For the Gaussian case, the composite BME-DPC scheme achieves the following rate C l £f IE _ DPC . 
Furthermore, Cbme-dpc > CbmEi, k - In other words, the composite BME-DPC scheme always achieves a 
better rate than the BME scheme for the Gaussian scenario. 

'-BME-DPC 




h 2 12 P 2 + 2h 01 h 12 JaP^ } P 2 



h 2 aP {1) \ h 2 P [2) 



subject to: 

p(l) , p(2) _ p 

P + Pq -it, 

h + t 2 = l, 

< ti,t2,P 1 ,P 2 , 

< a < 1. 

where a = 1 — a. 

Proof: As in Theorem [3j we assume that r E l n = 0. Now, we show that every rate pairs (R^ , i?( 2 )) 
satisfying ( 1101l )-( IT07l i satisfy ( l26l i. After specializing ( I101b -( ll07b for the Gaussian case and comparing with ( t26l ). 
one observes that the second term in minimization d 1 1 1 does not exist. Substituting r^j = in (|102| i-( fT07] >, 
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Relay 1 

ka / 



Source 



Destination 



Relay 2 



t 4 



Fig. 6. Simultaneous relaying protocol for two relays. 



one can obtain the other three corresponding terms. Comparing those terms with d26b . it can be readily seen that 



Remark 1 Assuming r Bin = 0, as in Theorem\3\and corollary\3\ the destination jointly decodes the current message 
and the bin index of the next message at the end of even time slots and then it can decode the next message at the 
end of odd time slots. Therefore, using backward decoding is not necessary in the BME-DPC scheme. 

B. Simultaneous Relaying Protocol 

Figure [6] shows simultaneous relaying protocol. In simultaneous relaying, in one time slot of duration £3 the 
source transmits its signal simultaneously to the two relays. In the next time slot of duration t±, two relays transmit 
their signal coherently to the destination. Hence, in this protocol, t\ = ti = and our system model follows from 
© and ©. 

1) Dynamic Decode-and-Forward (DDF): In DDF scheme each relay decodes the transmitted message from 
the source in time slot £3 (Broadcast (BC) State), and forwards its re-encoded version in time slot £4 (Multiple 
Access (MAC) State). The following Theorem gives the achievable rate of the DDF scheme for the general discrete 
memoryless channels. 

Theorem 4 For the half-duplex parallel relay channel, assuming simultaneous relaying and the fact that what the 
second relay receives is a degraded version of what the first relay receives, the following rate C l £f) F is achievable: 



r~ilow v /~ilow 

L -BME-DPC — ^BME back - 



dow 
DDF 



max 

0<t3,*4,t3+*4 = l 



R p + R, 



(27) 



subject to: 




(28) 



Rc<t 3 i(u™ ; r 2 (3) ), 

Rp + Rc^UIiX^Kx^-^). 



(29) 



(30) 
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with probabilities: 

p(4 3) .4 3) )=p(«o 3) m4 3) I'4 3) ). 
k4 4) ,4 4) )=k4 4) m4 4) i4 4) )- 

Proof: The achievable rate of DDF is equal to C l £f, F = R v + R c , where (R p , R c ) should be both in the 
capacity region of BC (corresponding to the BC state) and MAC (corresponding to the MAC state). Applying the 
superposition coding of the degraded BC [12] the following rates are achievable for the first hop: 

R P <hI(X^-Y^ \U&), 

R c <t 3 I(U^;Y 2 {3) ). (31) 

with probability p{u^\ x^) = p(u^ )p(x^ ) . 

And using the superposition coding of the extended MAC (See [25], [26]) the following rates are achievable for 
the second hop: 

R p <tJ{X^,Y^\xi\ 

R P + Rc < UI{X^ ] , X^ ] ■ F 3 (4) ). (32) 
with probability p(x^ , x^) = p{xf^)p(x^ ■ 

(3) (3) 

In the Gaussian case (assuming hoi > ho%), the source splits its total available power Pq to P p and P c . 
associated with the "Private" and the "Common" messages, respectively. Letting X^ 3] ~ /V(0,P o ), ~ 
TV ffJ, P (3 C } ) , and X[ 4) ~ Af (0, Pi), assuming that relay 1 and relay 2 transmit their codewords associated with 
the common message with AT (o, P^f) and AT (0, P 2 ), and using OTT l and ( l32l we have the following corollary. 
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corollary 4 For the half-duplex Gaussian parallel relay channel, assuming simultaneous relaying protocol with 
power constraints at the source and at each relay, DDF achieves the following rate 



subject to: R p < min t 3 C 



'h 2 P (3) ' 



(4)' 



, t±C 



h 2 P y > 



Rr. < hC 



Rp + R c < t^C 



' h 2 P (3) \ 

f h 2 p {4) 

' t 13- r l,p 



23' 



(3) 



0,p 



-^ofi — ^Oi P^p + P^ c ~ ^1 ' *3 +*4 — 1) 



0<t 3 , ti, i£> 4^ ^ ^ 



0,c ' l,p ' l,c • 



(33) 



Interestingly, successive decoding at the destination does not degrade the performance of DDF scheme in the 
Gaussian scenario as shown in the following Proposition. 

Proposition 3 The rate of DDF scheme is achievable by successive decoding of the common and private messages 
at the destination. 



Proof: Consider the sum rate for both the common message and the private message for the extended multiple 
access channel from relays to the destination, 

',2 p(4),/i.... 



i?p + R c < t&C 



h 2 13 P% + (hi 3 JPX + h 23 Vm* 



(34) 



U 

It can be readily verified that subject to the constraint P^ + pj^ = P±, the right-hand side of ( f34-b is a decreasing 
function of or equivalently an increasing function of P^ . Now, let us equate R p in d34"t with the private rate 
R p of another MAC which is achieved by successive decoding of common and private messages. Therefore, we 
have 

' 4 13- r l,p 



Rp — Rp — t^C 



< nc 



h 2 P y ' 



u 



(35) 



According to d35l ), we have (See Fig. [7]l 



p(4) < p(4) 
1,P — l.P 

R v + R c < R v + 



Rc < Rc 



Rc 



Hence, {Rp, R c ) lies in the corner point of the extended MAC with parameters {P^, P[ ^ ), i.e. successive decoding 
of common and private messages achieves the DF rate. ■ 
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Private Rate 




R c R c 



Common Rate 



Fig. 7. The order of decoding "Common" and "Private" messages. 



C. Simultaneous-Successive Relaying Protocol based on Dirty paper coding (SSRD) 



Relay 1 



Source 




Destination 



Relay 2 

a) Time slot 1 with duration ti 



Relay 1 



Source 




Destination 



Relay 2 

b) Time slot 2 with duration tj 



Relay 1 




• Destination 



Relay 2 

c) Time slot 3 with duration tg 



Relay 1 



Source 




Relay 2 

d) Time slot 4 with duration tt 



Fig. 8. SSRD Scheme for the Half-Duplex Parallel Relay Channel. 



In this section, we propose an achievable rate for the half-duplex parallel relay channel. Our achievable scheme 
is based on the combination of the successive relaying protocol based on DPC scheme and simultaneous relaying 
protocol based on DDF (SSRD scheme). Hence, we have the following Theorem. 

Theorem 5 Considering Fig. [3] for the half-duplex parallel relay channel, SSRD scheme achieves the following 



DRAFT 



rate C{ 



SSRD- 



C 



's'sRD = mm (Rl + Ri + R5 + Re, R2 + R3 + R" + R» + -R9) 7 



(36) 



subject to: 



R9 Re , Ri + ^ R3 + ^7 5 < + -^8 ■ 



(37) 



Proof: SSRD scheme is illustrated in Fig. [8] As indicated in the figure, transmission is performed in 4 time 
slots. Relay 1 transmits its private message which was received in time slots t\ and £3 (corresponding to rates R\ 
and i?5) in time slots t 2 and t± (corresponding to rates R3 and Rj). On the other hand, relay 2 transmits its private 
message which has been received in time slot t 2 (corresponding to rate R4) in time slots t\ and £4 (corresponding 
to rates R2 and i?§). Furthermore, the two relays send the common message they have already received in time slot 
£3 (corresponding to rate Rq) coherently in time slot t± (corresponding to rate Rg). As observed, here we consider 
the private rate for both relays in the MAC state, i.e. time slot £4. This is due to the reason that relay 2 also receives 
the private message in time slot t 2 - Hence, from the above description and Fig. [8] we have 



Cssrd =min {R l +R 4 + R 5 + R 6 , R 2 + R 3 +R 7 + R s + R 9 ) , 



(38) 



subject to: 



Rg < Re, Ri + R5 < R3 + R7, Ri < R2 + R& ■ 



(39) 



Using corollaries Q] @] and Proposition [3] for the Gaussian case we have 
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+ i 2 c' h2 ° 2P ° 2) 



tl 



t 3 c 



'h 2 p (3) 

"CUM 



0,p 



■t 3 C 



h 2 P (3) 



U + h 2 P f 



(3) 



02- 1 0,p , 



h 2 P (2) 
*2 



i 4 C I 3 1,p - — = 3 - 2 ^- J + t 4 C 



subject to: 



WA (4 c } + WP 



i 4 C* 



t 4 + hf 3 P liP + h% z P 2v 
2 \ 



I 4 + fti 3 r-i )P + n 23^2,p 



h 2 p (3) 



,*3 + ^02-f(),p 



Z/.2 pW\ ( h 2 P (3) ' 



(2)' 



/V p (2) ' 



^23^2 ^ 



t 4 c 



L2 pi. 



a 23 r 2,p 



+ t 4 C 



P 



(1) 



P 



(2) 



P 



(3) 



O.p 



P 



(3) 



(2) 



p(4) , p(4) _ p 



P 



(1) 



P 



(4) 



p(4) _ p 



2 ~ * 2,p 
+ *2 + *3 + U = 1 



< tl, tl, t 3 , ti, Pg , Pn , P ( 



(1) D (2) D (3) D (3) p(2) p(4) D (4) D (l) D (4) 



P 



1 ' l.p ' 1,C ! 



p 



p?', p 



(4) 



2,p i °2,c 



(40) 



According to corollary [3j another combined simultaneous-successive relaying protocol based on BME is not 
necessary. However, a "Simultaneous-Successive Relaying protocol based on BME-DPC", can be easily derived. 
Assuming the first relay decodes the second one's message, the achievable rate of this new scheme would be the 
same as C l gg RD . However, since the messages for the second relay are common, Pg in the expression of the 
achievable rate is zero. Furthermore, the following constraints instead of d39b should be satisfied: 



P9 5: P4 + Rq, Pi + P5 5: P3 + P7, Pi + P4 5~ t\I ( Xq , X 2 ; ^ 



(41) 



IV. Optimality Results 

In this section, an upper bound for the half-duplex parallel relay channel is derived and investigated. The authors 
in [27] proposed some upper bounds on the achievable rate for general half-duplex multi-terminal networks. Here, 
we explain their results briefly and apply them to our half-duplex parallel relay network. 

Authors in [27] define the concept of state for a half-duplex network with N nodes. The state of the network is 
a valid partitioning of its nodes into two sets of the "sender nodes " and the "receiver nodes " such that there is no 
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active link that arrives at a sender node, and t m is the portion of the time that network is used in state m where 
m G {1,2,... ,M}. The following Theorem for the upper bound of the information flow from the subset Si to the 
subset S2 of the nodes, where Si and S2 are disjoint is proved in [27]. 

Theorem 6 For a general half-duplex network with N nodes and a finite number of states, M, the maximum 
achievable information rates {R lJ } from a node set Si to a disjoint node set S2, Si, S2 C {0, 1, . . . , N — 1}, is 
bounded by 

M 

£ sup mm^UU^^lX^). (42) 

/ (ml (ml (ml \ - O \ ' 

ieSi,jeS2 P( x o < x 2 f->*}i-iJ>tm m=l 

for some joint probability distribution p(xq , x^ , ■ ■ ■ , when the minimization is over all the sets S C 

{0, 1, . . . , N — 1} subject to S f] Si = Si, Sf] S2 — $ and the supremum is over all the non-negative t m subject 
to X^i $m = 1- Here, Xg 1 , Ug , and XgZ' denote the signals transmitted and received by nodes in set S, and 
transmitted by nodes in set S c , during state m, respectively. 

From Theorem [6] the maximum achievable rate C low is upper bounded as 

clow < c u P a min ( fi/ ( X (D. Y V 1 X (D) + y [x^.y^ I + hi (xf; y/ 3 \ F^) , 

i 2 l(xf\xP;YP,YP) + hl(x<i*>;Y<*>) +hl (x[ 4) ;Y^ 4) \ x!f> 
hl(x£\xP-rt l \YP) +i 3 l(x^;Y^) +hl{x^;Yt ) \X^ 
til(xP;Y^) +i 2 l(x^;Y^)+Ul(xt\x^ ] Yt ) )) , (43) 



subject to 

h + i 2 +4+4 = 1. 

By setting £3 = ti = in d43l . we obtain an upper bound on the successive relaying protocol which we call it 
successive cut-set bound in the sequel. 

Theorem 7 In a degraded half-duplex parallel relay channel where the destination receives a degraded version of 
the received signals at relays, i.e. X^ — ► Y^ — ► Y^ and X± — ► Y^ — ► Kj , BME based on backward 
decoding achieves the successive cut-set bound. 

Proof: Setting £3 = £4 = in (l43l and comparing the result with ( TToT l the Theorem is proved. ■ 
In high SNR scenarios, we have the following Theorem. 

Theorem 8 In high SNR scenarios, assuming non-zero source-relay and relay-destination links, when power avail- 
able for the source and each relay tends to infinity, time slots i 3 and £4 in ( 1431 ) tend to zero as O ^ lQg 1 p ^ ■ 
Furthermore, the upper bound on the capacity of the half-duplex parallel relay channel in high SNR scenarios is 

1 



C U P = C l0W c + Q 



logPo 
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In other words, DPC achieves the capacity of a half-duplex Gaussian parallel relay channel as SNR goes to infinity. 

Proof: Throughout the proof, we assume the power of the relays goes to infinity as P\ = 71P0, Pi = 72-P0 
where 71, 72 are constants independent of the SNR. Substituting X^ ~ W(0, P (1) ), X {2) ~ W(0, P (2) ), ~ 
AA(0,P (3) ), X[ 2) ~ N{0,Pf } ), X[ i] ~ tf(0,pW), X£ ] ~ AA(0,P 2 (1) ), and X< 4) ~ AA(0,P 2 (4) ) in g3), and 
assuming complete cooperation between the transmitting and receiving nodes for each cut in (@3), we have 

/ / u 2 P (1) \ ( h 2 P (2) \ /f/j 2 + /jMP (3) \ 



tiC 



ta J \ £4 I 

' f&pP | (h\ 2 + hl,)P^ | 2h 01 h 12 ^P^ hl.hl^P^ 
t\ t\ t\ t. 



(h 2 p (1) \ (h 2 p (2y 
i lC l^K 2 - )+i 2 c' 13 1 



. 4C ( ^A (4) + ^ 2 (4) + 2^ 1 3fe 2 3V / A (4) ^ (4) j j (44) 



subject to: 



p(l). 


p(2) 
M) 


,p(3) 


A (2) + 


p(4) 


= A, 


p 2 (1) + 


p(4) 


= P 2 , 


£1 + i 2 


+ 4 


+ 4 = 



Po, 



n <r f f f f p (1) p (2) p (3) p (2) p (4) P (1) P (4) 

U S £l, £ 2 , £3, £4, r'o ' i > -M > A > ^2 ' ^2 ■ 

Furthermore, from corollary Q] the achievable rate of the DPC scheme can be expressed as 



£iC('^Ut 2 c(^')). (45) 
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By setting P^ = P^ = 4^ and t\ = ti = 0.5 in d45l ). expression (l45T l can be simplified as 

C l ££ c >UnP Q + c. (46) 

where c is some constant which depends on channel coefficients. Knowing that the term corresponding to each 
cut-set in d44l i for the optimum values of i\, ■ ■ ■ ,£4, is indeed an upper-bound for C' l £p C , and by setting Pq = 
Pq 2 ' = Pq 3 -* = Pq in d44l i. we have the following inequality between d46b and the first cut of d44b . 

1 InPo + c <| In (^) + I In + I ln r + ^ 



2 " 2 V *i / 2 V h J 2 V h 



'1 



2/ioi-Po 2/i 02 P 2(/i 01 + /i 02 )Po 

4 ). l n Po + I l n ^ + I hl + | l n (/& + ft§J 



2 u 2 Ui 2 

_*i ln£ x -kfott-k inf 3 + _JL_ + + f 3 . (47) 

2 2 2 2/i 01 P 2h 02 P 2{h 01 +h 02 

Note that in deriving d46b and d47l ), the following inequality is applied to lower/upper-bound the corresponding 

terms: 

ln(x) < ln(l + x) < bx(x) + -, Vx > 0. (48) 

x 

Consequently, we have 

U < T~77 ( 2c + *i m ^01 + *2 In ^02 + h In (/iqi + ^02) ~ *i m *i _ ^2 In 4 - 4 m 4) 
1 / f 2 f 2 f 2 



In Po V ^oi p o h 2 02 P (h 2 01 + h 2 02 ) P 
Hence, we can bound the optimum value of < 4 in (l44t as 



< U < O I — ^— ) . (49) 



>gPo 

Similarly, by considering the fourth cut in d44i i, we can derive another bound on the optimum value of £3 as follows: 

< i 3 < O (r^—) . (50) 



>gP 

Applying the inequality between (l46l ) and the term corresponding to the second cut in (PPfl i. knowing (from 
and d50b ) the fact that I3 < j^pr, and £4 < j^p- (where C3 and C4 are constants), and using inequalities d48l . and 

ln(l + x) < x,Vx > 0, (51) 
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we obtain 



-lnP + c< 



2 \ *2 \ 7l^l3-Po ^02 ^13^0 ^i3^02v/7r-Po 



'"2 



2 (t 2 /i§ 2 fo + hli {h\ 2 + ft? 3 ) P + 2f 2 /i 02 /n 2 VtT-Po + ^isTi-Po) 

£2 f2 
c 3 , c 4 



2/i§ 2 P 2 7l /i2 3 P 

4, fhlnhZ^A B B(h 2 + h 2 

< t 2 In P + tt In I ° - 3 I + 4 + ~r 



12 "T "13; , <- 2 »-12 



2 V J 2 7l / l 2 3 p 2/ l 2 2 / l 2 3 p Q 2^3^02^/7!^ 



n 



— — — In hm - — In £3 H — - H — — ln 71 /i?o — ln £4 H — -- 

21nP 02 21nP 2 21nP ' 13 21nP 2 

*i 

j — h 

2 (t 2 h 2 02 P + taj! {h\ 2 + h 2 3 ) P + 2t 2 h 02 h 12y /j{Po + h^hj^P 2 ) 
p 22 



2h 2 2 P 2 7 i/ l 2 3 P 
Therefore, we have 

1 



In P + c< t 2 ln P + c 



+0 

Hence, 







(lnPo) 









2 logPo 

Similarly, from the third cut of d44b . for we have 

1 Cl 



1 c 2 

< t 2 . (52) 



<ti. (53) 



2 logPo 

From d52l and d53l . and also the fact that t\ + £2 + £3 + £4 = 1, we obtain 

^i^M + kilV (54) 

^i^M + kJlV <55) 

Hence, from d49l l, d50l l. (l54l i. and (IB3T l as Po — > 00, £3, £4 ^ and it, t 2 — > 0.5. This proves the first part of the 
Theorem. 

Moreover, knowing that each term corresponding to the four cuts in (l44l i is greater than 0.51n(Po) + c and as 
t\,t 2 are strictly above zero (approaching 0.5), we can easily conclude that 

P^,P ( \ 2 \P^,P 2 {1) ^Q(Po). (56) 
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Now, we prove that the DPC scheme with the parameters t\ 



ti + 



, ti = i 2 + H^, P, 



(i) 



P (1) and 



P (2) =P (2) , where t lr 



£4, Pq X \ Pq 2 ^ are the parameters corresponding to the maximum value of ( 144) . achieves 



the capacity with a gap no more than O 



log Pn 



To prove this, we show that each of the four terms in (1451 1 is no 



more than O 
have 



logPo 



below the corresponding term (from the same cut) in (f44l . To show this, for the first cut we 



h 2 P 

''01 M) 



h 2 p (2y 




< 



Here, (a) follows from (l48l l, noting the function t 1 ln(P 



maximum value at x < 



t 3 



-Pn and hence substituting P} 

*3 + *l U 

result in (b) , (c) follows from 4, £4 ~ ^ (k^p^) 

p (1) ,F (2) ~e(p ). 



(3) 



y) + 1 2 ln(y) + i 3 In (£ 3 + (/& + h 2 02 ) x) 

(i) p(2) 



(57) 



ft,Q 2 ) a;) takes its 



t 3 



ts+ti 



Pn and finally noting Pk ' , P, 







and In ( 4i 

*i 



O 



1 



logPo 



e(P ) 



, and finally (d) follows from 
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Next, we bound the difference between the terms in the fourth cut of (|44| | and the fourth term in C l £p C 




Here, (a) follows from (g8]i and noting P{ ' , P 2 U ~ 8(Po), noting the function t\ ln(P 2 - y) + t 2 ln(Pi - x) 
U In (h + (h 13y /x + h 23y /y)' 



PI 
O 



(4) 



Pi and P 2 (4) 



takes its maximum value at x < - * 4 - Pi , y < - * 4 ~ P 2 and hence substituting 

+ M+fl 



- * 4 - P 2 result in (b), (c) follows from £3,^4 

t4+tl 



log Pf) 



and ii, fa ~ 0.5 



and finally (d) follows from the facts that ^ ~ 0(1), i\ + £4, 4 + h ~ 6(1), and £4 ~ 



Next, we bound the difference between the terms in the second cut of (l44t and the second term in C^pc 

2h 02 hi 2 \ 



t 2 C 



h 2 P 

k 



5(2) 



(fc? a + ft?3)A (a) 



i(2) 6(2) 



P Q ^ 



1,2 ft 2 6(2) 6(2) 



tl 



1-2 
'"2 



+ t 3 c 



h 2 P 

' t 02- r 
t 3 



(3)' 



+t 4 C 



(4) 



j(2) 6( 2 ) 



In 



u2 u2 p\-J p\ 



u2 1.2 p\*i p 
"02"l3- r fj 

4+4 



P 2 



P (2) A 




J.2 1,2 6(2) p 
' t 02' t 13- r r l 



Here, (a) follows from g8j, the fact that P (2) = P W - 6 (P ) and upper-bounding P^> < P , P^> < Pi 



,12) 



(3) 



o ^ 



,(-1) 



(6) 
< 



A (2) 

noting the facts that P V 



P (3) < P) and P[ 2) 



P 1 (4) = Pi, the functions i 2 ln(P - x) + £3 In (4 



'02 



5) and 



(59) 
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i 2 In (Pi— v)+t4 In ({4 + hi<,y) are maximized at x < » % Pn and y < * *" 4 * Pi, hence, substituting pi 3 ^ = - *" 3 * P 

v ia ' £2+13 u 

and Pf' = |^Pi upper-bounds the expression which results in (b), (c) follows from £3, £4 ~ O ( iogP ) >*i>*2 ~ 
0.5 + (ts^) , and finally (d) follows from the fact that P (2) , Pi - 6 (P ) and also i 3 ,i 4 ~ O (17^7) ■ 

Noting that the second and the third cuts are the same, and using the same argument as in (1591 . we can bound 
the difference between the terms in the third cut of (l44l and the third term in C l £p C as 

h 2 6(1) ( h 2 , u2 \p(l) 
I Q I 01 _|_ vjlg ' a 2Z) r ^ 




+i 3 c ^y° (3) j + t 4 c i ^y j - t x c ^ U1 ^ u j - he [ ) < o ( 7— —77- ) . (60) 

Observing d57l i. d58l l. d59l and ( f60b . completes the proof of the Theorem. ■ 

Theorem 9 /« /ow S^W? scenarios, assuming Pi = 71 Po, P2 = 72 Po w/th 71,72 constants independent of the SNR, 
when the power available for the source and each relay tends to zero and (/ii3^/7i + ^23-\/72) 2 < nain (/igii ^02)' 
f/ie raf/o 0/ f/ie achievable rate of the simultaneous relaying protocol based on DDF to cut-set upper bound goes 
to 1. In this scenario t 3 = t± = |, and no private messages should be transmitted. 

Proof: By the same argument as in Theorem [8] and considering only the fourth cut, we obtain another upper 
bound on the capacity. By the following inequality 

ln(l + x) < x. (61) 

we can bound the upper bound on the capacity as 

n u P ^ (feigVTi + ^23^) 2 -Po 

6 - 2h2 • (62) 

Now, assuming ti = t 2 = 0,t 3 = t& = i, and transmitting just the common message, we can achieve the 
following rate C l £% F : 

C l ^ F = mm (ho (2h 2 Q2 P ) , hj (2 (h 13 ^yl + h 23 V^f ft)) • (63) 

According to the Taylor expansion of ln(l + a;) at x = 0, we have 

x 2 

x - — < In (1 + x) , (64) 



Hence, 



In 2 I 2 2 ' 2 1 - DDF ' 



By (|62]i, d65j, and (/ii3 N /7i + h 23y /^) 2 < min (ft.01,^02)' we have 



lim i^OF ^ L (66) 
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V. Simulation Result 

In this section, the achievable rate of different proposed schemes, i.e., SSRD, DPC, BME, and BME-DPC are 
compared with each other and with the upper bound in different channel conditions. 

Figure [9] compares the achievable rate of the SSRD scheme with that of the DPC scheme for successive relaying 
and the DDF scheme for simultaneous relaying protocols. Here the symmetric scenario in which Pi = P 2 and 
^01 = ho2 = h\2 = hi3 — h-23 = 1 is considered. The upper bound is also included in the figure. 

In order to satisfy the condition in Theorem[9] i.e., + h^^/y^) 2 < niin (/Iqd ^02)' m Figs.[9k an d b, we 

also assume P = P 1 + W(dB) =P 2 + 10(dB) and P = P 1 + 5(dB) = P 2 + 5(dB), respectively. As the Figs. |9ji 
and b show, SSRD achievable rate almost coincides with the upper bound over all ranges of SNR. As proved in the 
previous section, in high SNR scenario, SSRD scheme coincides with DPC and the successive relaying protocol 
becomes optimum, while in low SNR scenario it coincides with DDF and the simultaneous relaying protocol is 
optimum. 

On the other hand, in Figs. [9J; and d we assume that P = P l = P 2 and P = P x - 5(dB) = P 2 - 5(dB). 
In this situation, the condition in Theorem [9] is no longer satisfied. Therefore, as these figures show, the ratio of 
the achievable rate of the SSRD scheme to the cut-set bound, i.e., g;,-g p does not tend to one. Furthermore, the 
achievable rates of the SSRD, DPC, and DDF schemes coincide with each other. 

Figure [lO] compares the achievable rate of different successive schemes with each other and the successive cut-set 
bound. It shows as the inter relay channel becomes stronger, BME scheme can achieve the successive cut-set bound, 
while the achievable rate of the DPC is independent of that channel. Furthermore, this figure indicates BME-DPC 
gives a better achievable rate with respect to BME with successive decoding which was proposed in [32]. 

VI. Conclusion 

In this paper, we investigated the problem of cooperative strategies for a half-duplex parallel relay channel with 
two relays. We derived the optimum relay ordering and hence the asymptotic capacity of the half-duplex Gaussian 
parallel relay channel in low and high SNR scenarios. 

Simultaneous and Successive relaying protocols, associated with two possible relay orderings were proposed. 
For simultaneous relaying, each relay employs DDF. On the other hand, for successive relaying, we proposed a 
Non-Cooperative Coding scheme based on DPC and a Cooperative Coding scheme based on BME. Moreover, a 
coding scheme based on the combination of DPC and BME, in which one of the relays uses DPC while the other 
one employs BME was proposed. We showed that this composite scheme achieves a better rate with respect to 
cooperative coding based on BME with backward or successive decoding in the Gaussian case. 

We also proposed the SSRD scheme as a combination of the simultaneous and successive protocols based on 
DPC. In high SNR scenarios, we proved that our N on-Cooperative Coding scheme based on DPC asymptotically 
achieves the capacity. Hence, in the high SNR scenario, the optimum relay ordering is Successive. On the other hand, 
in low SNR where (ft.1371 + h 2 3j 2 ) 2 < min (h^jh^), DDF achieves the capacity. Hence, in low SNR scenario 
and under the condition specified above for the channel coefficients, the optimum relay ordering is Simultaneous. 
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P =P 1+ 10(dB)=P 2 +10(dB) 



b) P =P 1+ 5 (dB)=P 2+ 5(dB) 
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Fig. 9. Rate versus relay power. 



Appendix A 

Proof of Theorem 1 

Codebook Construction: 

Let us divide time slot number b, b = 1, 2, • ■ ■ , B + 1 into odd and even numbers. At odd and even time slots, 
source generates 2 nr Aux and 2 nr Aux sequences (qi) and ((72) according to YilHi P( u< ol) an d X^i=iP{ u ^o\)' 
respectively. Then, source throws Uq and u 2 ^ sequences uniformly into 2 nRi ' and 2 nRi ' bins, respectively. Let 
us denote B^w^) and B^[w^) as the set of sequences at the odd or even time slot that belong to the w^'th 
bin, respectively (for odd time slots, u/ b ' < 2 nRl , and for the even time slots, u/ b ' < 2 nR{ ). 

Relay 1 and relay 2 generate 2 nR( ' and 2 nRi ' i.i.d and x^ 1 "* sequences according to probabilities Lj'i™ V ) 
an d Lli=i V (^ x< 2i ) ■ Furthermore, for all q\ and (72, the source generates double indexed codebooks Xg 1 ' (w^ |«/ 6_1 ) , q\) 
and x 2) (u; (f,) |w (b_1) ,(72) according to Y[^=iP( x o} I x 2^' u o!i) and IT'l™ p( x< o} I ^i^o^)' respectively. 

Encoding: 

Encoding at the source: 
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Fig. 10. Rate versus inter relay gain. 



At the odd time slot b, the source intends to send the message w 1 -^ to the first relay. In order to do that, since 
source knows what it has transmitted during the last time slot to the second relay, it chooses a codeword Uq 1 "* (qi) 
such that Uq 1 '' (qi) g Bi(w^) and ^Uq 1 ' (qi) (u/ b-1 ))^ £ A^ l \ Such a task can be done almost surely, if 
r Aux ~ R{1) > ti 1 ( C7 o 1) ;^2 1) ) ( See [!2])- Following that it sends x^u^x^). 

At the even time slot b, the source sends the message to the second relay in the similar manner. Such a 
task can be done almost surely if r% x - i? (2) > t 2 I ( ; x[ 2 A . 

Encoding at relay 1: 

At the even time slot b, relay 1 encodes ii/ 6-1 ' g {1, ■ ■ ■ , 2 nR(1) } to x^ (u/'' -1 '). 
Encoding at relay 2: 

At the odd time slot b, relay 2 encodes u/ 6 - 1 ) g {1, • • • , 2 nR(2) } to x^ 1 ' (w^ 1 )). 
Decoding: 

Decoding at relay 1: 

At the odd time slot b, relay 1 declares = u/ 6 ' iff all the sequences uj, 1 ' (gi) which are jointly typical with 
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belong to a unique bin B\{w^). Therefore, in order to make the probability of error zero, from [12], we have 

r% x <til(u£\YP). (67) 
According to d67l ) and the encoding condition at source, we have 

R^<h(l(U^;YP)-I(U^;X^)). (68) 

Decoding at relay 2: 

At the even time slot b, relay 2 declares = iff all the sequences Ug 2 "* (q2) which are jointly typical with 
y^ belong to a unique bin B2{w^). Therefore, in order to make the probability of error zero, from [12], we have 

&<yK»;f). (69) 

According to d69l ) and the encoding condition at source, we have 

R^<t 2 (l(U^-Y^)-I(U^-X^)). (70) 
Decoding at the final destination: 

At the odd time slot b, destination declares u^ 6 " 1 ) = u/ 6-1 ) iff ^x^ (w^ 1 ^ , y^ 1 ^ € Hence, in order 

to make the probability of error zero, from [12], we have 

R {1) <ti/(X 2 (1) ;F 3 (1) ). (71) 

Similarly, at the even time slot b, we have 

<t 2 I(x[ 2) ;Y£ 2) ). (72) 
From the encoding at the source and j6*71)-(|72l), we obtain (l9l-([TTIi. 

Appendix B 

Proof of Theorem 2 

Codebook Construction: 



Let us divide the time slots b, b = 1,2, • • • , B + 2 into odd and even time slots. The source generates two 
codebooks x 1} (wW\w ( - b - 1 \ sf~ 2) ) and x 2) (w<® l^ 6 " 1 ), 4 & ~ 2) ) of size 2 " flU> and 2 nHW corresponding to 
even and odd time slots, respectively. The first codebook is generated according to the probability p(x , x 2 , Uj 1 ' ) = 

\ x 2h u 2i)> and the second codebook is generated according to the probability 

On the other hand, relay 2 generates 2 nr B%n i.i.d codewords u^ 1 "* and 2 nR<2) i.i.d codewords x^ 1 ' according 

to the probabilities p(u^) = 11*=" Pi u 2i) and p( x< 2^ I u 2 ) = Y[t=i P( x 2i I u 2i) at eacn odd * ;mie s ^ 
and relay 1 generates 2 nr Bin i.i.d codewords uf^ and 2™ fl( ' i.i.d codewords x^ according to the probabilities 
p(u^) = riil ? iP( u i 2 i ) and p( x i^ I u i ) = Ilil'iPC 3 '! 2 ] I u< il) at eacn even tmie s l ot ' respectively. 
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Encoding: 

Encoding at the source: 

At the odd time slot b, source encodes £ {1, ■ ■ • , 2 ni?<1> } to (w^lw^ -1 ^, Sj 6-2 ^) and at the even time 
slot b, it encodes u/ b ' € {1, • ■ ■ , 2 ni?(2> } to x 2 ^ (^w^ Itz/ 6 " 1 ), s^ 2 ') anc l sen ds them in odd and even time slots, 
respectively. 

Encoding at relay 1: 

At the even time slot b, relay 1 encodes the bin index of the message u/ b ~ 2 ) it has received from relay 2 

in the previous time slot to (s^ 2 M. Following that, it encodes u/ 6-1 ) which was received from the source 
in time slot b — 1 to x^ 2 "* ^u/ b_1 ) \s^ 2 ^ and sends it. 

Encoding at relay 2: 

At the odd time slot b, relay 2 encodes the bin index Sj b 2 ' of the message u/ b ~ 2 ) it has received from relay 1 
in the previous time slot to (s^ 2 ^. Following that, it encodes u/^ 1 ' which was received from the source 
in time slot b — 1 to x^ 1 ' ^u/ 6-1 -* jsj 6 2 '^ and sends it. 

Decoding: 

Decoding at relay 1: 

Knowing iz/ b ~ 2 ) and consequently , at time slot b, relay 1 declares (w( b ~ 1 \w( b ' ) ) = (w^^^jW^) iff 

there exits a unique (u)( b_1 ' , w^) such that 

Hence, in order to make probability of error zero, from the Extended MAC capacity region (See [12], [24], [25], 
and [26]), we have 

R^< h l(x^;Y^\X^\u^), (73) 
rU+RW < ytlW^Vi' 1 ' I Ui l) ). (74) 

Decoding at relay 2: 

Knowing i(/ b ~ 2 ) and consequently s^~ 2 \ at time slot b, relay 2 declares (u)( b_1 ), u>( b )) = (w ( - b_1 - ) , uK*)) iff 
there exits a unique (u)( b_1 ' , w^ b ^) such that 

(x 2 ' (t&Wlt&C- 1 ),,^) ,x?> (^l^) ,uf>(4 b - 2) )^ 2) ) € AW. 

Hence, in order to make the probability of error zero, from Extended MAC capacity region (See [12], [24], [25], 
and [26]), we have 

R^<t 2 I(X (2) -Y^\X (2 \u (2 \ (75) 
i?W +RW < t 2 I{xf\x[ 2) -Y^ 2) | u[ 2) ). (76) 

Decoding at the final destination: 

Decoding at the final destination can be done either Successively or Backwardly as follows. 
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1 ) Successive Decoding: 

At the end of odd time slot b, destination first declares the bin index Sj 6 2 ' = Sj 6 2 ' of the message u/ b ~ 2 ) iff 
there exists a unique ^ such that (u^ (sf 2 ^),y^^j € Hence, in order to make the probability of error 

zero, from [12] we have 

r^ n <hI(U^;Y^). (77) 

Having decoded the bin index 2 "* of the message w^ h ~ 2 \ destination can resolve its uncertainty about the message 
w (b - 2 *> and declares w^ 2 ^ = w^ 2 ^> iff there exists a unique u>( b ~ 2 ) such that (x[ 2) (w^-^ls^),^ \s$~ 3) ),y£ } ) € 



A ™ . Hence, in order to make the probability of error zero, from [12] we have 

R (1) -r^ n <t 2 I(X^;Y^\ui 2) ). (78) 
Using the same argument for the even time slot b, we have 

rgL<t 2 /(^;yW), (79) 

fl (a) -ra,<* 1 J(^ 1) ;y 8 (1) |^ 1) )- (80) 
From ([77), GS, ([79), and ([80), flW and R^ are bounded as follows 

< i 2 /(x^;F 3 ^ | C/f) + tl l(uW;YW) , (81) 
i?( 2 ) < hI(X^;Y^ | +^([/ 1 (2) ;K i (2) ). (82) 

From (|7"3"l>-(|76l>, dSTT l. and (182) , the achievable rate of BME scheme based on successive decoding is equal to 

0&_ = il« + il«<^ ii n^ =i n«n( (83) 

min^/^yW |i<V«) ,t 2 /(^ 2 ) ; ri 2 ' | ^) + W (t/ 2 (1) ; y 3 (1) )) + 

mmLlixP^P | [/«) +i 2 /([/f);r 3 ( 2 )) ^ifx^yp) | x[ 2 \ [f > 



tl l(x£\xV;YU | [/«) ,t 2 /(^ 2 \^;y 2 ^ | 0?>)) . 
2) Backward Decoding: 

Following receiving the sequence corresponding to the B + 2'th time slot, destination starts decoding the messages 
in a backward manner, i.e. from u)( B ' > back to w^K At the end of odd time slot b, knowing the value Sj from the 
received signal in time slot b+ 1, destination declares ^w' b ~ 1 - ) , s 1 ^ 2 M = ^■u/ b ~ 1 - ) , 2 M iff there exists a unique 
pair (>-*), S f" 2 >) such that /<& (tSf" 1 )) = and (x 2 1} (zi^ 1 ), 4 & " 2) ) ,u 2 1} (^~ 2) ) ,y 3 1} ) G 

Similarly, at the end of even time slot b, knowing the value l ' for the received signal in time slot 6+1, 
destination declares ^w)^" 1 ', ,s 2 b 2 ^ = (w^ b ~^ , s 2 b 2 M iff there exists a unique pair ^w^ 1 ' 7 s 2 b 2 ^ such that 
= 4 b ~ 1] ^d (xf (taC- 1 ),*?- 25 ) ,u< 2) (4 b ~ 2) ) ,yf ) G Hence, in order to make the 
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probability of error zero, from [12] we have 

r < bl<R {1 \ (84) 

r [ Bl<R {2 \ (85) 

« (2) ~^<M(llV 3 ( V 2 (1) ), (86) 

^-rgL + rgL ^(XMW*), (87) 
R {1) -r% n <hl(xW;YW\uW), (88) 

RV-r%l + r% n <t 2 l(x?\uP-,Y<*). (89) 

Hence, by employing BME and Backward decoding, the following rate is achievable subject to (|73Tl-(|76]l and 
d84j»-([89]> constraints. 

C l BM Eback =R {1) +R (2) . (90) 

Optimum input distributions 

Now, we prove there exists input probability distributions (jp(xq , x 2 , u 2 ) and p(x^ , x± , Ui )) which max- 
imize d90l > and have the following property: u 2 is independent from (xq ,x 2 ) and is independent from 
(xq 2 '*, xj 2 ''). To prove this, consider p(x^ , x% > u 2 ) anc ^ p( x o 2 ' i ^i 2 "* > "l 2 ') a l° n g with ti, *2 which maximize d90b 
subject to the required constraints. Let us define p(xq , x 2 , u 2 ) and p{x^\ x^\ ) as 

p(x^,x 2 1 \u^)=p(u 2 1) )p(x^,x 2 1) ), (91) 
p(4 2) , 4 2) , ? 4 2) ) = p{u^ )p(x% ] , 4 2) ), (92) 

Now, we show that p(£g X \ a; 2 , ^4 ) an d Pi x< o \ x i 2 ^ i "i 2 "*) along with ii,i2 achieve at least the same rate as the 
optimum one. Let us denote the values of mutual information and entropy with respect to the input distributions 
p,p by Ip,H p and I p ,H p , respectively. The right-hand sides of (f86b-(f89b with respect to p can be upper-bounded 
by the ones corresponding to p as follows 

t,I p I t/ 2 (1) )<U (XP;YP) = t xh (x^yP) , (93) 



t,I p (X«,f/«;F«) ^t,I p (X«;F«) = tl I p (x^) , (94) 
t 2 I p (X?\YP I U^)% 2 I P (X^-YP) = ^ (xf>;lf > ) , (95) 



t 2 I p (xP,C7f ;y 3 (2) ) { ^ 2 I P (X?;YP) = t 2 I p (x^;Y^) . (96) 
where (a) follows from the fact that — ► -X"^ — * ^3 f° rms a Markov chain and (b) follows from the fact 

(2) (2) (2) (1) (2) 

that U[ — > X{ — > Y" 3 ; forms a Markov chain. Moreover as in distribution p, u 2 and u\ ' are independent 
from (xq ,x^ ) and (a?Q , a;^), it can be easily verified that the right-hand sides of d93ll-(l9"6il are equal to the 
right-hand sides of (I86l)-(f89|) with the input distribution p, respectively. Hence, by utilizing p instead of p, the region 
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that satisfies (I86ll-(l89ll is enlarged. Now, let us consider the right-hand sides of d73l>-(l76l>. 

tJ p (x£\YM \xM,U^ tl I p (xV;YW | X«)= ^ (x« ; y« | X«) (97) 

^(jtfUJWWO^ = tl I p (x£\x^;Y^) (98) 

t 2 I p (x^ ;F 2 (2) \x[ 2 \u^)<t 2 I p {x^;Y^ \X™) = t 2 I p (x™-,Y™ \X™) (99) 
t 2 I p (X^\X^-Y^ | U^)< t 2 I p (xf\xP-YP) = t 2 I p (x^,X^;Y^) (100) 
where (a) follows from the fact that — ► [X^\x^) Y^ form a Markov chain and (b) follows from 

(2) f2l (2^ C2l 

the fact that U\ > — > (X\ \X^ ') — > ' form a Markov chain. Similarly, we observe that the right-hand sides 
of d97T>- (l 1 00b represent the right-hand sides of inequalities (l73b-(l7oT) with the input distribution p. Hence, the region 
of {R^\ B> 2 ') that satisfies d73ll-(|76li and d84li-(l89l is enlarged by utilizing the input distribution p instead of p. 
This proves the independency of input distributions with uW and in the optimum distribution. 

Simplifying the achievable rate 

As we can assume that the input distributions are of the form d9"TT l and d92l ). the achievable rate can be simplified 
as follows. 

C 1 SZk, , = R (1) + R {2) < 



max 

o<t 1 ,t 2 ,t 1 +t 2 = 



im in(tj(x^\x^;Y^),t 2 l(x^\x^;Y^)), (101) 



subject to 



with input distributions 



r Bin 



(1) <i? (1) , (102) 

r { B ] in <R {2 \ (103) 

RW<t x l(xP-,YV>\xP), (104) 

R (2) <t 2 /(4 2) ;F 2 (2 > \X[ 2) ), (105) 

^-rgL + rgL <t 1 j(4 1, ;n <1) ). < 106 > 
p(x {2 \x{ 2) )=p(x {2) )p(x (2) \x (2) ). 
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Now, we show that ( 1 1 1 b - ( fTOTb is equivalent to 

C l B °ME back < n ^ t max min^/fx^X^;^) , t 2 I (x™ , X< 2) ; F 2 (2) ) , 

U<-tl ,12-11+12 — 1 V V / \ / 

t 1 i(x^\xP)+t a i(x^\x^), 

hllx^^+^I^^)). (108) 

First, it is easy to verify that ( |101b -( fT07T > imply (|108t . Now, in order to prove that the converse is also true, we 
show that for every possible rate r satisfying (11081 ), there exists a quad-tupple LR^ , R^ 2 \ r^j n , r^JJ) such that 
+ = r, [R^, R( 2 \ rgj n , r^J^j satisfies dlOlb - dTOTb . and moreover at least one of bin rates is equal to 

(!) n ( 2 ) n 

zero, i.e. r B { n = or r B ' m = 0. 

Let us define i?W = min (r,t x I (x^lY^ | X^)), R^ = r - As r satisfies ( fT08l , we conclude 

that (R^\R^>) satisfies dToTt , < flQ4l and < fT05b - Furthermore, as i?W + i?< 2 ) = r < tj (x^; Y" 3 (1) ) + 
t 2 I (x[ 2) ;Y£ 2) \ we conclude that either < i 2 7 (xf 5 ; y 3 (2) ) or i?( 2 ) < tj/ (x^; y 3 (1) ). For the sake 
of symmetry, let us assume that the first case has occurred, i.e. i?' 1 ' < t 2 I [x^ ; Y^ 2 ^ . Now, we define r B J n = 
and r (2) m = max (o,i?< 2 > - hi (x^; F 3 (1) ) V Obviously, (fT02t . ( [T03T l, and (fl06l are valid. Considering dT07t . 
we have 

- rgL + rffl, = + max (o, r - - t x J (x«; Y 3 (1) )) < t 2 I (x^Y™) (109) 

where (a) follows from the facts that r < t x I (x^; F 3 (1) ) + t 2 J (xf >; Y" 3 (2) ) and < t 2 I (x[ 2) ;Y^ 2) y 
Hence, (1107b is also valid. The second case in which R^ < t±l(x^;Y^J can be dealt with in a similar 
manner. 

Hence, from the above argument, the achievable rate of BME scheme with backward decoding can be simplified 
as follows: 

Csm S6 < max wmfhlfxW^YW) , t 2 I (x$\ X< 2) ; F 2 (2) ) , 
il 7(x«;Y«|X«) +i2 /(4 2 ) ; yi 2 )|X^) ) 

W(^;y«) + t 2 /(xf);rf)), (110) 

with probabilities 

I (2) (2)\ / (2)n / (2) I (2)n 

?(io ,x\ ') =p{x\ ')p{x y >\x\ '). 
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